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Pro jebt^ staff and experi^ced child welfare personnel 
adapted the Culture' Simulator to tr^in child^ welfare caseworkers to 
have an empdthic understanding o^ minority children and families in 
order to encourage and support iathnic identity, integrity, and 
community life. The/training technique used 4 self-instructional 
modules containing 40. critical casework incidents (derived from 
discussions with '180 San Antonio, Texas, barrio r^^idents) depicting 
misunderstanding between Hexican American clients and AngJLd American 
child welfare workers due to differences in their soclocultuxal 
backgrounds* Trainee^ (27 non^Hlspanic child welfare workers) were 
instructed to rank the^ 4 alternative explanations for the 
misunderstanding in each vignette according to the-Best^tp*th6*least 
preferred, answer* Trainee^ were given the teaching volumes, each with 
^ a test form and rationales, in sequence* After^. reading the rationales 
in order of their*answer selection, trainees scored their own tests* 
Bedults from traineefs and 3 control groups. (46 child welfare and 
family service workers tiasted with single volumes) indicated Jthat 
signif^icant cumulative learning took place^ the techni^UQ was equally 
effective with experienced and inexperienced vorlc^rs and for those 
with extensive' exposure to the Hexican American community^ and the 
best results were obtained when the modules were followed by 
\ discussions designed to integrate the knowledge gained* , 
(Author/CH) ' , ^ * ' . • 



]^*^«««««« ««««««««««««««««««««««««« ««««]|t#««^«««««««#««««««««««««^««^^#«« 

* . Beptoductlons supplied by BDRS are the best chat can t>e made 

♦ ' , from the original document* * ^ ^ ^ 



ERIC 



oo 
o 

Q 
UJ 



PEftMISSlON TO REPRODUCE THIS 
MATERrAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERiCr* 



TECHNICAL REPORT / 
TjjE MEXICAN AMERICAN CULTURE SiMULATOgt FOR CHILD WEfcFARE 

"Frank F. Mental vq, D-S-W. . 
Director, Culture Simulator Programs 



Tonia T, Lasater, M.S-W. 
Child Welfare Consultant and Trainer 

Nancy Garza, M.S.W. 
Resear'ch Assistant 

December 1980 
(Revised June 1981) 



SUMMARY 



U S OC^ARTMCin Of (OUCATION 

NATIONAL INSTITUTE Of lOUCATlON 

eoucaXjonal REsouRces ^^fof^VlATlO^ 

Vno* tyjt-^ tw j%*<j* -o ^c^r--^ 



The training materials and methdds described in this report were developed 
by the Wordgn School of Social Service, Our Lady of the Lake University of San . 
Antonio, supported by Child Welfare Training Grant Number 90-CW-1967 (SSA Sec 426). 
The project was funded for 1979-1980 by the Children's Bureau, Department of 
Health and Human Services, as having national significance for improving services 
to^the Hispanic community. , j. / 

The project employs an innovative training technique, the Culture Simulator, 
deve'toped for business people employed by multi-national corporations and educators 
preparing to teach abroad. As adapted for this project, it involves a self- 
instructional module consisting of 40 critical casework incidents depicting 
misunderstanding between client and worker due to differences in their sociocul tu/al 
backgrounds, rn this case, Mexican American clients and Anglo American child welfare 
workers. The incidents were developed by the project staff and experienced child 
welfare personnel from 30 group interviews with 180 residents of low income Mexican 
American corminities in San Antonio, Texas in 1980. 

,This technical report provides a detailed description of the Instructional 
and field testing methods employed, the major limitations of the technique, and 
the statistical evaluation of the instrunent- the Mexican American Culture Simulator 
fbr Child Welfare-^ The results indicate that significant cumulative learning takes 
place; that it is equally effective with experienced and inexperienced workers arjd 
for those with extensive exposure to the Mexican American comnunity, and that the 
best results are obtained when the self-instruction module is followed by discussions 
desigfied to integrate the. knowledge gained. 

The purpose of culture simulator training is to improve empathic understanding 
of minority children and families in a manner that encourages and supports their 
ethnic identity, integrity and corrniunity life. ^ 
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In'structfonal Method 

* * * • 

r A Culture Siniulator is, composed of a number of elements; a critical casework 
incident of about 150 words that depicts a cross-cujtural , problematic transaction 
created j)^ the differences in values, beliefs, or lifestyles between an Hispanic 
client and non-Hispanic child welfare worker. The incident is written in the form 
of a vignette or short scene. This is followed by a question that focused on the , 
client-worker interaction and four multiple choice answers which provide aiterrTative 
explanations for the client's or the worker's behavior. The alternatives suggest 
the probable causes of the actor's dilefnma. Few are totally incorrect. 
# • \ ' 

The trainee is then instructed to choose the best answer and read the 
corre^onding rationale, which explains why the answer that was selected is or 
is not the best one available. He or she continues^seTfecting alternative answers 
,and reading rationales until the best one. is selected and confirmed by its 
corresponding rationale- It may require as few as one selection or as many as 
four before the reader continues to the next vignette. * 

Rationales for the less-than-best alternatives provide opportunities for 
correcting misconceptions, stereotypes, or less appropriate fnterventions, 
rationales for the best answer explain the nature 6f the traditional value in 
question and suggest more effective and culturally responsive casework approaches 
to the situation. The rationales are thejjefore the key elements irv-the vignettes 
and the primary teaching devices-used in constructing the module- 

The Culture* Simulator has tfie following unique features: 

1. It is directly practice-ot^iented and jbb-related. • 

2- It enabled the trainee to learn at his own pace, in private, and in a location 

convenient to hi>- 
3. It involves the trainee in an active problemjsol ving experience. 
4- It exposes trainee to standardized material, which enables him ta assess 

his progress. • • ^ , 

5. It assures that all trainees will be exposed to the same material, which 
controls for variation in the trainer's expertise. , f i . 

6. It reduces the risk of overgeneralizing and developing "new'' stereotypes. 
7^.\It ehables trainers with varying backgrounds to utilize the material. - 
,5. \t provides for the efficient distribution and uttlizati(Jn of training 

'materials- ^ . 

9. It facilitates the testing, evaluation, and Improvement of teaching materials. 
10. It can be used for various educational and research purpos'^s. ^ 

* The self-instructional module was very well received as a* teac^hing r)ethod 
by workers participating in the project^ who saw the technique as a motivative, 
enjoyable, and informative approach to understanding the Mexican American culture. 

The literature in cross-cultural psychology refers to this instructional 
method as the "culture ass1m11ator'*-(l) Assimilation, however, implies the replace- ^ 
mertt 6f one set of values for another, which Is no't the Intent of training. The 
authors prefer the term. ''cultural simulator^' to refer to the simiflatlori of cross- 
cultural Interactions that reveal inappropriate responses by persons unaccuTtu rated 
to the community resident's culture. These responses are considered appropriate 



to the trainee's own values or are in keeping with sound professional practice , 
within his or her culture* The differences result in conflict, misunderstanding 
or confusion of either or both the participants in the intexactions . As such, 
the sit^iati9ns are considered to be tritical incidents for teaching and lear*mng 
purposes. . • ' . 

* ■ r 

The culture assimilator techniaut has, beerj most widely developed by the \ 
,Oepartment of Psychology at the University of Illinois by Or. Harry C. Triandis. 
Since 1956, eight ins.truments dealing with Arabic, Iranian, Greek, Thai, Kondurian 
and black American cultures have been developed A Thre Mexican Merican Culture 
Simulator for Child^WeUare, is the first that wa3 developed for the helping 
professions, focused of^ family values and prescribed corrective intervention^. 
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Source of Materials 



Critical Incidents were gatheif^d by the project ^taff a nd^ twenty one experienced 
ctiild welfare supervisors, trainers and workers from the Texas Department of Humdn 
Resources who comprised the research group in the projett. The three-person teams 
conducted thirty group intervi'ev!s in English and Sparvi>h throughout San Antonio in 
T986, The interviews were arranged with the help of seven conmunity outreach service 
centers. J\ total of 180 barrio residents, young and old, , male and female, were 
asked to di'scuss s.ituations where they, felt that a difference in family ^values, ^ 
customs or beliefs caused a misunderstanding between themselves and othel*s. The 
interviews were minimally structured and the partici^^^ts were allowed to discuss 
a>iy subject pertaining to their lifestyle tha^ they wished. Only d few residents 
participated in more tl?^n one session. Each sessjon lasted approximately three 
hours. 

By the fifteenth group interview the value th^es dis.cussed began to become fy 
repetitive and familiar to the project staff, at least one of whpm was a i^kt of 
each in*terview]ng team. *^bis observation enabled the ^taff to examine tha^ilue 
in question in more detail with the participants and ask about conditions when or 
situations where it would not apply.' The "exhaustion'* of value themes during the 
course of the interviews i^^an important point* Firsi, It indicated that ^the 
basic array of core v.alues was being tapped by the interviewers. Second, ^t ^ 
enabled the staff tct explore the core values in more detail without risk of over- 
looking others. Third, it partially met a major criticism of the culture simulaXcfr 
technique: that because 6f its fonnat it fai'ls to expose the reader to all the 
major values in the culture. The projectls focus on family rather^han personal 
values probably enabled the staff .to cons^truct an instrument that included most of 
the major values. * ^ ^ 

The Research GiToup - • • , 

The selection of experienced child welfare personnel asciembers of the 
research group was intentional/ It wa? importa/it that the simulator thoroughly 
reflect problems and issues that were, relevant l^ot only to practice but addressed 
agency policies Sind procedures. It was also critical that the workers depicted in 
the vignettes realistically t*ep resented .those without masters degree level training 
and with less than three years Of experience, that is, tho/irrte'nded recipients of 



^ 3 




culture simulator training. Only a group composed of experienced supervisors, * 
trainers andNvorkers provided the* desired agency and worker perspective^, ^ 

. "Since die training recipients werjs to be primarily non-Hispanic workers, ^* 
the research group was made up of mostly Anglo Americans (17 of 21 }. In addition 
to. the two Hispanic staff members, the four Mexican American workers conducted 
the Spanish language interviews as well as others,. This ethmc mix in the project 
allowed for a comparison of data and for a dual perspective in constructing the 
training materials, ,In this manner, the sensitivity of both ethnic groups was 
dealt with. The results were synergistic values and opinions were closely 
examined and separated from myths and stereotypes and the resulting vignettes 
and rationales were carefully documented and explained, • 

The research group was divided into two research subgroups of approximately 
equal numbers who were subdivided into research teams. The teams met during 
separate training, field and work sessions for a total of ten days each over a 
.three month period, Eacii^ team was given an orientation to Mexican American and 
Anglo American values based on a review of over 300 literature Hems, and were 
trained to conduct f ield*<nlerviews. They were tauQht to identify and select . 
values themes and develop aod construct tultural vignettes prior to conducting 
the interviews. The total group produced 50jjj/ignettes,\40 of which were .^^c ted 
for training and testing, 1 ' ^ 

Testing Materials and Methods ^ . W 

* 

The 40 vignettes were divided into four volumes in grder to provide a con- 
venient method of testing the'troitfee's learning. When more than one vignette 
addressed a certain value they tfiey were distributed among the volumes. The 
relative difficulty to solve a given vignette was not considered since this infor- ' 
matfon was not available at the time. Multiply choice test forms for each volume 
were made up of the critical incidents, questions, and alternative answers without 
the accompanying rationales. The pre-post evaluation was composed of the test forms 
for volwne 1 and 4, respectively. 

Answer sheets were constructed ^or each test form. The trainees were ii^^tructed 
to select the four alternatives in each vignette in accordance with the-ibest-to- 
the-least preferred answer, ' ' ' . 

The trainees were then glyeri the teaching volumes (.with rationales) in sequence 
as they completed each of the four test, forms &nd turned in one of their two copies 
of the answer sheet, Hith the remaining copy of the answer sheet, Hhe trainees read 
the rationales In order of their answer selection and scored their own tests. This 
procedure enabled one to examine individual and group learning curves for trainees 
across the four volumes and to Identify the easy and more difficult vignettes. 

The nunber and per cent of correct responses for individuals and groups were 
analyzed as well as the response pattern formed by the groups' choice of first, 
second, third, and fourth answers for each vignette. Also, an Improvement vatp ^as 
tabulated for each group, which was computed by dividing the -difference between the 
pre and post test scores by the difference between the pretest score and the maximum 
possible score attainable. 



A total of 73 sabjects'were itivolved in the testing phase. 27 TDHR personnel 
participated trr' testing t^ee different training mettfods (Training Groups C, 
and E);^46 parti c1 pa tect fn tes^ting individual volumes (Test Groups F, G, and H). 
Volumes two, three, and four, were, tested separately and individually with differ- ^ 
ent sutsamples in order to determine whether the training groups' improved ^scores 
were due to chance or cuiiulative learning. The subsample scores were uniformly 
lower. than the training' groups ' scares indicating that cumulative learning took 
place for the Tatter. ^ . . ' 

Major Limit^tioos of Instructional and Testing Methods 

1. The .project was subject to the realities and limitations of conducting field 
research apd trainfnq in a large scale service organization. In spite of excellent 
administrative cooperation from many regional offices, last minute unavailability 
of. Subjects, unclear directions f rom» the project's office," and the loss of sub- 
jects because of caseload emergencies underscored the real difference between "pure' 
lafboratory testing and relevant field research. As developmental research, the 
staff initiated new inquiry based on the errjerging data, developed new working hy.- 
poJtheii^ and sought samples to test them in order to strengthen the training de- 
sign^ana goals 'of the project'. ' ' ^ 




,yrtQ of the small size and mixed characteristics of the s^bsarrtples the 
moduleSf^ tested ratfier vigorously in view of its'earTy stage of aevelopment* 
The X2 contingency test was used for samples with Idss than 12 subjects and the 
t test way used to compare the means of samples with'^lS or more subjects, The^ 
results are presented in Table 1, Child Wei fare* Project Results.- 

2. Another technical limitation concerns ^the traditional instructional fqrmat that 
was utilized in. this project for providing feedback. The branching formatval lows 
for self-paced learning, but doet n6t fully exploit the potential for learning that* 
can take place by the trainee's reading all the 160 rationales in the module. 
Trainees and supervisors often report th^ a less-than-^best answer may have been 
rejected because of guessing or for an inappropriate, unclear, or wrong reason. 
The branching format fails to coVrect and clarify why the rejected answer was a poor 
explanation and fails to deepen and reinforce the trainee's understanding. 

An instruction procedure that takes somewhat longer to ^elf;adm1nister, but 
requires the trainee to reatf all the ^rationales, Is known as the "linear" format, 
(2). The procedure requires the development of a standardized scale against which 
the trainees compare the degree of confidence they have in their answer choices. 
Recent experJments reported inth€^ literature on this new method indicate that, the 
linear format Is superior In Improving their ability to solve more difficult vi- 
.gnettes. The feasibility of ysing the linear format in this project will be exr 
amined dijrlrjg o»)-go1n|^ refinements of the Instrument. Neither format, however, 
addresses the following technical limitation, which also fails to ^apitalije on all 
the material contained In* the module. 



3. It should be^noted that the test form of volume four only Measures the learning 
that Is gained from among theil20 rationales in the previous three teaching volumes. 
.Rationales from volume four are reviewed by the trainees only after they hav^e scored 
and subinltted their answer fo the test form of that volume. Consequently, only the 



impact of 75% of the ;noduTe (three of the four volunies) has been measur^ thus far. ' 
Several alternative pre-post tests» that dp not require the development of ad- 
ditional vignettes, are-t)eing examined to tesfthe full teaching potential of the 

module. , , . " " 

« 

Solutions to these technical limitatio^ns are expected to greatly improve the 
effectiveness of the simulator without dimi*nishing its efficiency. ^ 

4. The present formyof the module has not been tested and validated with known 
groups qf experts frpm the Mexican Anierican cofnmumty. Partial content validity is 
offered since^t-he critical incidents and rationales were developed, from interviews 
with members of the Mexican American Ijarrio comnunities in San Antonio. % 

.5. -The module does, not purport to teach the trainee about the total distribution 
cyf values and beliefs that e;<ist*in the corrmunlt/, nor about the extent and depth 
to which they are held. Rather, it attempts to teach non-Hispanic workers about 
the more traditional or core values that are related, to the family and are held by . 
many Mexicah Americans. This approach was based on its relevancy for practice with 
urban and rural poor and' migratory workers who tend to adhere to traditional values • 
and on its potential application, to. Me;<ican Americans and Hispanics in other parts 
of the United States. 

6. The risk of stereotyping or over:gener|lizing materials presented in cultural 
awareness training is common. This training modulefis also ijot irrmune to this 
danger, although steps were taken to minimize the risk. Most of the focal and 
operative values dipicted in the incidents appear as secondary values in other vi- 
gnettes. Conseouently, a value or belief tha^ best e;<plains why a misunderstanding 
took place in one incirtervt is a possible but not the best explanation in another. 
This was done in order to emphasize the point that circumstances and relationships 
often influence the specific value that is acted upon from a cluster of cultural 
alternatives. 

7. Finally, culture is not taught simply. The module only claims to provide an 
introduction to the Mexican American culture and does not fJretend to offer an in- • 
depth understanding of the people's lifestyle. The purpose is to facilitne the 
development an alternative perspective of practice and to encourage self-motivated 
study and additional training for non-Hispanics who have primary responsibility for 
serving the Mexican American cotimunity. 

The biggest risk and limitation in using this training approach is that it 
would be viewed as Sufficient for effective practice. Hence, our .recotimendatibn is 
that it be used as an educational tool by trainers and supported by more specific 
training and testing. The field supervisor'^ assessment of the worker's perfor- 
mance will constitute' the ultimate test of the module's effectiveness. Such be- 
havioral meaiures are rare in the state-of-the-art of cultural awareness .training. 
Consideration is being given, however,, to developing performance criteria during 
the continuation and refinement of cultui^ simulators-. • ' 
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Preliminary Statistical Analysis 

All training and test group results must be viewed as Tentative in view of 
the small samples involved and the weak control of independent variables resulting 
in the lack of matched groups. This underscores the difficulty of conductino re- 
search under field conditioYis* The statistics discussed below are presented in 
table form at the end of this report. 

Training Group Characteristics 
•I • ^ 

Group C' , * 

Coinposition: 7 non-Hispanic child welfare workers with from 2 to 7 years 
tenure and an average of almost 6 years in TDHR, None had post-graduate degrees 
and they represented different sections of 'Central and South Texas. 

* 

Training: 4,5 days of cultural awareness training which included basic\ * 
concepts in minority intergroup relations; clarification of cultural values, 
vignette analysis and construction, community field interviews and experience, 
in preparing' and writing cultural vignettes. 

Test: Pre-post forms composed of 20 casework vignettes evenly divided intd 
two volumes (1 and 4). 

Group D 

Cofm/osition; 8 non-Hispanic child welfare workers with from 3 to 9 years 
tenur^ith an everage of 7 years in TDHR,^ None had post-gratiuate degrees and 
they represented different sections of Central and South Texas. 

Training: Two days of cultural awareness training using the four volume 
module with 40 casework vignettes, and 120 teaching rationales. Approximately 
two hours V)f discussion following the administration of each volume. 

Tests; Pre-post test forms composed of 20 casework vignettes evenlQ divided 
into two volumes (1 and 4). Test forms for volumes 2 and 3 were used to jneetsure 
the learning process between the pre-post tests. 

Group E 

« 

Composition: 12 non-Hispanic chi\d welfare workers with from 1 month to 3 
years tenure and an average of less than 1.5 years with TDHR. None had post-grad- 
uate degrejss and they wqrked in a smaller than average West Texas community with 
a relatively large Mexican-American population. 

V 
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Training: Two hours of training using the four volume module with 40 case- 
work vignettes and 120 rationeiles used for self-instruction. ^ 

Tests: Pre-post test forms composed of 20 casework vignettes^ evenly divided 
into two volumes (1 and 4). Test forms for volumes 2 and 3 wereNlsed to measure 
-the learning^ process between the pre-post tests. 



Evaluation Results 
The Training Groups:^ 4.5 days, 2 days and Simulator Training only 
Over Four Days Training vs. Two Days Trairiing 

Group C increased its selection of correct answers by 21% from 43% in volume 
1 to 64% 1n volume 4; Group D increased by 16% from 55% to 71%. In terms of the J 
relative patential for improvement for each group, botff groups improved at a siim-'* 
lar rate, 38% and 36%, respectively. Group C's improvement was significant at 
the .02 level. <3roup D's at .05. 

.The impression gained form this initial, small sample- testing was that two . 
days of training using the teaching module with discassipn, clarification, and 
elaboration of values appeared to be as effective in identifying the correct an- 
swers as the more extensive training conducted by the staff. 

As an Important cautionary note, however, it was also observed that those 
with a more extensive training made fewer poor choices on 20 pre-post test iteois 
as defined by selecting the correct answer on the fourth and last try, than those 
undergoing two days of training. Five percent (7/140) of Group C's- choices*.were 
poor, while 13% (21/160) of Group D's correct choices were made on the fourth 
try. Therefore, longer periods of training may serve to decrease mistakes rather 
than increase correct responses. The between group difference was statistically ~- 
significant at the .02 level. 

• This difference may reflect a limited ability of the test instrument to tap, 
except Indirectly, the greater pool of. knowledge possessed by some si^jects, since 
no array of test Items .can address all the value themes in a given culture. 

Self-Instructional Module Training vs. konger Training 

Based on the module's encouraging positive results, an attempt was made to 
test the power of the Instr.ument more fully. The module was' allmlnistered to a 
group of less experienced child welfare workers (Group E) after 60% of the vignettes 
had been revised and made more difficult to solve. The group underwent the modular 
training without the benefit of the discussion periods given to Group D. As such, 
the 'content, procedure, and subject characteristics presented a more severe test of 
the Instrument to teach cul^ral awareness to rron-Hlspanlc workers. 

* The results were that Group E Increase/lts pre-post test scores by 25% (from 
42% correct to 67% correct) and Improved at a rate of 42% be.tween scores. The 
Improvement was significant at the .01 level. This was a larger Increase and a 
greater Improvement rate than either Group C or D. 



Group E's pQor choice to'tal , how,ever, approximated Group D's 13" in that 12" 
(28/240) of that group's pre-post test answers were chosen on the last try. The 
difference between Group E and Group C .was statistically significant at the .05 
level. 

The conclusion was drawn that utilizing the module without providing addi- 
tional information appeared to be at least as effktive in choosing correct 
answers as the oth^r training methods and was superior in cost-effectiveness, 
approximately 90% nrare than Group C and 75% more than Group D. 

It can be demonstrated through an alternate'analysis that all groups im- 
proved by their selecting progressively fewer alternatives before arriving at 
tfte correct answer during the course of training. When the distribution of 
attempts was sunmarizad according to the h'rst- to -fourth placement of the correct 
answer in each vignette, consistent, but somewhat different learning patterns 
emerged for each group. Grbup C selected the correct answer only 3 times as 
its first choice in Volume 1, but 9 times out of a possible 10 in Volume 4; Group 
D's 'first place selection increased from 6 to 9; and Group E's selection increased 
from 5 to 7. Group D's remaining preference, however, was placed second^ while 
Group C'.s was pilaced a poor fourth, thus indicating that Group D reached a near 
perfect score by Volume 4. By this analysis. Group D's exposure to the module 
pJCis discussion was the most effective training method employed. 

An explanation of this method of analysis and a full display of the. group's 
learning patterns are provided at the end of this report. (See Table 2). 



Testing for Cumulative Learning. The Test Groups • ^ 

Volumes 2, 3, and 4 were admims^iered separately to three TOHR groups that 
became available to testing during the course of the project. The purpose of this 
procedure #;as to compare to the extent possible, the cumulative learning that took 
place from one volume to the next by training groups against the scores obtained by 
participants who were not exposed to other volumes. The test groups were expected" 
to score lower on a given volume than the comparable training groups. 

These tests also'helped to identify the relative difficulty of individual 
vignettes without their contamination by the subjects' previous learning. J/olune I's 
use as a pre-test for^the training groups served this same purpose. ^ 

Test Groups F, G, and H, differed in certain characteristics from the Groups 
C, 0, and E, and from each other, which were partially reflected in the results. 

Group F (n=17) was composed of family service workers with an average tenure ' 
of four years which ranged from 1.5 to 12 years with TDHR. They worked in rela- 
, tively smaller communities which cbntaineti few Mexican Americans. This group tested 
volyme 2 and chose 24% correct answers. This was close to half the scores (22% and 
28%) obtained for that volume by Group 0, 46%, and Group E, 52%. The Group F and 
E difference was significant at the .01 l&vil. 




^ . Group G (n=13) was composed of child welfare workers with an average of five 
years experience* ranging from one to 11 years. They practiced in small to mod- 
erate size comnumties with a proportionately significant Mexican American pop- 
ulation. T^is groap tested volume 3 and obtained a score of 39% correct. This 
was at least 10% less (10% and U%) than Group 0, 49%» and Group E, S0%. The 
difference between oroups G and E was statistically significant at .02 level. 

Group H (n=16) was composed of family service workers. with over seven years 
experience and ranged from two to 14.5 years on. the job. They worked in a large 
metropolitan community with a significant Mexican American,,j>optilation. This 
group JLested volume 4 and scored, a high 47% correct* However* this was 17% lower 
than Group C, 64%, 24% lower than Group D, 71%, and 20% lower than Group E, 67%. 
The difference was significant at the .05 level between Groups H ^nd E. 

• ' ♦ 

In all situations, the test groups' scores were from 10% to.2fe% lower than 
those obtained by training groups. Even the high, scor^of 47*^ obtained by Group 
. H on volume 4 was 17% less than the lowest; score obtained by a training group. 
Group C (64%). 

These preliminary finding strengthen the proposition that the higher scores 
' obtained by training groups are due to the cumulative learning that resuUqd from 
V exposure to the teaching module; 



Tenure, Community Sjze and Ethnic -Density as Variables 

The 23% difference between Group F and Gtoup H test^results is striking and 
significant at the .01 level. It is not completely accounted for by the possible 
differences in the difficulty of the volumes administered for testing, .they both 
varied to a somewhat similar extent from the same trainino gorups (Group F, 22- 
• 28% less, and Group H, 20*24% less). Some of the differences between Group F's 
and H's scores my be attibuted to the marked differences ifi their average tenure, 
4 years and 7 years, respectively, to the difference in their practice experienee 
and the greater proportion of Mexican Americans in Group H's community th^in i<j^ 
Group F's. 

Community size w« riot believed to be a critical factor since other subjects 
who practiced in smaller communities (for example, in Groups 0 and E) did not 
score lower than GroupMi, although the group? are not strictly comparable. 

Tenure in TOHR, or years of practice,* turned out to be a weak A/an'able upon closer 
eXiatnination. This was initially suggested by Group E's good performance, since 
this ,gorup averaged only 1.5 years of practice. When tenure was controlled for _ 
both Group F and H, itrwas discovered that whatever difference existed it was in" 
favor of . less tenured workers. For example, those with less than thfe* average 
tenure in~5roup F, which was 4.6 years, selected 26% correct answers while tho^e 
above the mean selected 20%. W Group H, those below the mean of 7.4-years 
selected 58% correct answers while those above selected only 33%, the remarkable 
25% difference was significant at the ,01 level. When lest Group G results were 
also analyzed there was no real difference between the' shorter and longer tenured 
workers, 40% vs. 39% respectively. The mean year.s in practice for this last group 
was also only 3.9. 
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In fact, when extreme tenure cut off points weipe selected for all test 
groups, three or less years for. shoi^ter term and six or more years for longer 
term, a similar pattern emerged. The mean years for, shorter term workers •was 
1.7 yearS*(n=10) and their cqrrect score was 35%; the mean years for lonqer 
term workers was 8.9 years (n-19) and their.total correct score was 33%. 

The only factor reported that could account for the difference betwe^'' 
Group f and Group H scores, is the difference in the proportionately greater 
number of Mexican Americans in the latter' s, community. Unfortunately, there- 
wasn^t anather sub*sample availa'ble with a similarly scarce Hispanic population 
that would ei^low sfor. verification of tiiis proposition. Training Group Z has 
demonstrated that extensive learning can take place wHen tJ\ere is extensive 
exposure, and Training Group D suggests that relatively hicjh initial scores 
do not preclude extensive improvement. 

- One last point is Emphasized by the comparative test group results. It , . 
was prpijosed earlier in this report thet extensive training appears to minimize 
the extent tt) which one makes poo^ choices more than it improves one's compar-^ 
ative abil'ity to select correct answers. on a test instrument. This point is 
reinforce? by the test groups' percent of poor, Tast choices, which averaged 12!^, . 
and waj similar to Group O's two-day training (13%) and Group E's modular training 
{12%).^ The reader should also remember that the results fo the analysis ^of ^ 
answer preferences (Table 2} indicated that Group D'^ modular-plus-discussion' 
training seemed superior to Group. E's training with the module only. Neverthe^lesf , 
Group C'which underwent 4,5 days of field training, failed the least tn choosing 
the correct answer by ghe fourth try 5%. ' ^ • • 

If this finding is borne out by furthef research, it is of more tha/i technical 
interest. It supports the contention that, practitioners should be judged as much, 
if not more, by th6 mistakes they' do not ftake than by the correct actions they 
do take. 

s ' 

■ I I 

Nevertheless, the test group data have generated more information than expected 
an<J answered more questions than were asked at the start of the project. 



/ Conclusions 

All training groups showed significant increase In their knowledge of the 
Mexican American culture and in cumulative learning even when only 75% of the 
teaching potential of the instrument was tested. Culture Simulator training 
proved to be cost effective when compared to other training approaches. 

The training was equally effective with experienced and inexperienced case- 
workers, indicating that the vignettes primarily tested' and taught knowlWge 
about the culture rather than about casework. 

Improvement occured even among workers with extensive exposure to the , 
Mexican American coirmunity. 

The results argue for supplementing modular training with extensive discus*, 
sion and supervised experience as an optimum approach to improving fhe module's 
effectiveness'. , 




''A 



TeacMng Module and Trainer's Manual 



The relative difficulty of indi,vidual vignettes was compared and examined 
according to the percent obtaining correct afM^^ for each on pre-tests (Volume L 



by Training Groups C, 0, and E; and VoTurfi^^S^ Test Group F; Volume 3 by Test 
Group 6", 5(nd Volume 4 by Test Group*H>. See Tal ^ 



Table 3 for- results. 



This procedure provided the initia'l basis to construct; 9 ne^ module composed 
of tvi^y^olumes with 20 items each "and containing a similar rtnge of less-to-more 
difficult vignettes and (patched, as much as possible, according to value themes, 

, A two-Y0lum8 teaching module is believe?! td be an optimum diyision since 
training groups reported experiencing significant fatique, during the administra- 
tion of Volume 4. The division provides fOr separate administration of 20^ vi- 
gnettes' and 80 ratioftales followed By a discussion session and subsequent eval- 
uation of practice More administering tKe second vo]iume--tA month's interval 
between volumes<C|s proposed as an experiment. to alloirfror effective integration 
and testing knbwledge gained: , ' ' / . . " • 

A trainer's manual has been developed to accompany* the teaching materials- 
Its purpose is to assist trainers to conduct discussions that help clarify, am- 
plify, and integrate the information contained in the vignettes. It includes 
instructions for administering the modular traini^ng, additional bacxkground'irt- 
formatipn in thej^ortn of a list of comparative family values and characteristics, 
and a- detailed analysis 6f eath vignette contained in the. module. The vignette 
analysis include discussions of the implications that.each incident has <or child 
welfare practice and bibli^raphic citations to which the trainer can refV for 
aclditional infonma^ion. - " . . \ 

The three volume set 1s the first 1n a series of, cross-cultural training 
inalerials utililing tlTe culture simulator technique that are being prepared by 
the Worderr School o^ Social Service at Our Lady of the Lake University ctf San_ 
Antonio under tt?e ^upervrsion of the project director. • ' 
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TABLE 1 

CHILlT WELFARE PROJECT -RESULTS 



Designation ^ 
Sarnie' Size , 
Average Years Tenure 
Practice FleW (a) 
Mex./Aner' Pop. (b)'/ 
^Training Period 



Maxlnum Score (c) 



"'^'"ir^ning Groups 



CHARACTERISTICS 



Test Groups 



C D E 

7 . 8 , 12 ' 

6 • « 7 " 1.5 

Child Welfare 

'(Varied) (Varied^ Ext 

4.5 Days 2-Days 2 Hrs, 



F 

17 
4 

FS 
Min 



, 6 
13 
5 

CW 

«0(1 



H 
16 

7 

Fs' 
•Mod 



Not Applicable^ 



70 



80- 



120 



170 



130 



160- 



WJMBER AND'PERjCEHT CORRECT 



SIGN. LEVEL (t) 



Vol<ftne;l 
Volume' 2 
Volume 3 
Voluqie 4 



30(.43) 


44 


[.55] 


511 


:.42) 


37 ( 


;.46; 


631 


r-52 




39i 


.49 


1 601 


.50) 


45(.W) 


571 


!.7lj 


1 801 


;.67) 



41(.24) 

I- 5l(;39) 

• 75(.47) 



F vs E(.Ol) 
G vs E(.02) 
H vs E{.05) 



Difference Vol\ ^1 
Imprdvement. i Rate (d) 


15(.21) 13(.16) , * 29(.25) 
* .38 ^ .36 .42 


Significance Level (t)* 
C vs D Fourth Choice 
C vs E Fourth Choice 


.02 .05 (.01) 
~ .05 



a. 
c. 



- Extensive » 



FSl^*, Family Servlcei CH « Child Welfare * . 

Mexican American population In community In proportion to non-Hlspanlcs. fxt. 
"H1n5 = Minima^ Varied • subjects from dl^erent communities. Mod = Moderate • 
Used as bails fS^omputlng percent* Maximum score attainable Is the sample size times 
ten v1gnettesj^|a|h each subject was tested. ^ - 
IflJprovement i^^|j^p^st-test •scofe) - (pre-test score) 

\ (Ha)^1mum 3tore)" - (prg-test ^core) 



* X test used with less than, U -subjects and tested for number of correct and Incorrect Items. 
^The t test used with 12 or more su}>jects; significance levels are In parenthesis. 



TABLE 2 

.^^ PREFEREED ANSWER PATTERNS 





GROUP C 


GROUP 0 


GROUP E 


1 • 


2 


3 


4 


ws 




i 


' 3 


,4 


MS 


1 

1 


2 


3 • 




ws 


Volume 1 


* X 


.5 


2 


0 


19 


6 




2 


0 


V16 


5 


3 


2 


0 


17 


Volume 2 


(rtpt j^dmlnlstered) 

^ I. 


5 


4 


1 


Q 


16 


7 


1 


,2 


' 0 


15 


Volume 3 


(NotjJdm1nlitered) 

# 


8 


2 


'0 


•Q. 


12 


6 


3 


1 


0 


15 


Volume 4 


9 


D . 


0 


1 


13 


9 


1 


If 


0 ■ 




7 


3 


0 


0 


13 


Difference 
.Val. IM 


6 -6 


1 3 -5 


2 -4 



ws = Weighted score 1s frequency times the choice number (1,2,3,4). Perfect score Is 10 for each vol^e. 
Groulp C reduced Its score from 19 to 13 (-6) out of a possible -9 (.66); Groups, -5 out of -6 (.83); 
Group E, -4 out of -7 (.57), Development and Use of table; Each vignette was analyzed for the group's 
preferred answer pattern by totaling the weighted score for each of the four alternative answers. The 
answer with tffe h)west tota> ^was'^glven. first place; second lowest, second place, etc. The correct answer 
was then Identlftei according to Its first to fourth placement for'each vignette In the volume of 10 
vignettes. The placements were then totaled for each volume. For example, G/oup C had 3 chofces In 
f1r*st place, 5 In* second pi ice, Z In third place, and none In fourth place for Volume 1. This procedure 
emphasizes the group's placement preferences and Ignores the extent to which one answer was selected over 
the others, and differs ^rom, the "percent correct" analysis previously cited In this report. For example". 
Group E*s Increase 1n>ercent correct was 24 and greater than Group C's 21%; by this analysis *roup E 
improved less fhanj^roup Ci Group D demonstrated the greatest Improvement with a near perfect score on^the 
last vol line., ^ 



TABLE 3- 



NUMBER OF SUBJECTS AND PER SENT CHOOSING ANSWERS A', B, C, ANP 0 

FOR VOLUME I ■ / 





* 

Vignette 




N 


A 


9 


C 


0 


' Pape ■ 


1. 


The ;Open Door 


• 


27 


07 


1 

04 


04 




1 


2. 


The Godparents 




43 


.07 


*(81) 


05 


07 


. -6 


a/ 


But I Told- Her 




37 


16 


'l 


03 ■ 




n" 


4'. 


Old Folks H Home 




44 


. 01 


05 


18' 


(77) 


16 


5, 


New Girl in Tovm 


* 


'43 


05 


09 


16 


(70) 


21 


6. 


The Bureaucratic Labyrinth^ 


il3. _ 


16 


12 


(65) 


07 


26 


7, 


Play Ball 




37 


03 


13 


(57) 


.27 


. 31 


8, 


■ 

Divorce 




37 


01 


11 


38 


(51) 


36 


9, 


Cribs arid Scissors 




43 


(51) 


26 


05 


19 


y 41 


10. 


Irile'rpreter 

* * 


* 


37 


16 


(51) 


22 


11 


46 


11. 


' Hissed Days 




37 ; 


01 


24 


(49) 


27 


51 


12. 


Birth Control 


* 


37 


16 


- 22 


(49) 


13 


•56 


13. 


Foste^ Car0* 




37 


(40) 


11 


40 


08 


■ 61 


14. 


The Wedding 




43 - 


09 


(37) 


35 


19 


66 • 


15. 


* 

Full House ' 


t 


36 


(28) 


05 


01 


67 


71 


U. 


Kiss the Baby 




;27 


" (19) 


11 , 


30 


40 


76 


17, 


We Even Ate' Frogs 


* 


37 


03 


16 


(16)" 


65 


81 


18, 


Adios Senor G^ant 




27 . 


07. 


44 


(15) 


33 


86 


19. 


Lady in Di^.tress 


* 


27 




52 


26 


15 


91 


20, 


Football Weekend 














96 

4 



Correct answer in parenthesis. 
Vignette No^ 20 not tested. 



t 

* L 



lb 

15/ 



( 
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r TABLE 3 (cont..) 

NUMBER OF PAI^TICIPANTS AND PER CENT CHOOSING ANSWERS 
. A.B.C, AND & FOR VOLUME H 





Title . ' ' 


N 


A 


B 


C 


D 


Page 


• 

1.' 


Underfed, Overcrowded t 


> 
27 


1 


4 


(92) 


4 


1 


2. 


La Mo11era Caida 


36 


6 


1 - 


6 


(89) 


6 


"3. 


Jerry 


43 


(74)' 


9 


14 


2 


11 


4. 


Fefeling Blue 


37 


32 


14 


V 


^(54) 


16 


5.. 


Changing Subjects 


37 


5 


(54) 


3 


38 


21 ' 


6. 


Pots and Pans \. 

\ 


27 


.22 


15. 


7 


(56) 


26 


7 


1 lie UCUU(#ull('C 


27 




(55) 


15 


26 


31 


8. 


Broken Bones and B111s 


■ 26 


23 


1 


(50) 


27 


*36 


. 9. 


The Lessen of Two Evils \ 


43 


26 


14 


(51) 


9 


41 


"10. 


Wedding 8e11s, 


.2-6 


8 


4 


38 


(50) 


46 


11. 


The Missed Appointment 


43 


(35) 


5 


28 


33 


51, 


12. 


Nursing Rome 


37 


1 


, (35) 


16 


49 


56 


" ••13. 


Three Eqifels No ^ 


27 


. 11 


(33) 


11 


'44 


61 




Family Food Stamps 


37 


32 


(32) 


27 


8 


66 


15, 


iComo^ta? 


39 


13 


54. 


2 


(31) 


71 


-16. 


' Montez 


37 


(30) 


5 


2l' 


41 


76 


• 17. 


^Bareffibt and Pr^nant 


37 


3 


3 


(24) 


70 


81 


18. 


Da ting, Game 


37 


14 


„ 56 


(19) 


*11 . 




19. 


Senorlta Esplnosa 


37 


(11) 


5 


76 

* 


8 


91 


20. 


The Denial ^ . 












96 

i 



Coci^ect answer in' parenthesis. 
Vignette No. 20 not tested. 
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